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Abstract 


This  paper,  in  the  spirit  of  last  year’s  artide, 
is  a  contribution  toward  a  unified  theory  of  data  fus¬ 
ion  as  an  integral  part  of  a  more  general  C3  theory.  A 
computationally  feasible  and  mathematically  sound  pro¬ 
cedure  is  proposed  here  for  the  combination  of  dispar¬ 
ate  information,  prior  to,  and  compatible  with,  ordin¬ 
ary  conditional  probability  evaluations.  This  is  based 
directly  upon  a  new,  breakthrough  concerning  the  exten¬ 
sion  of  classical  probability  logic  to  a  full  condit¬ 
ional  logic. 

1.  DATA  FUSION  InO  C3  PROCESSES 
1.1, Qualitative  aspects. 

Previously,  in  03  4  general  approach  to  data 
fusion  wit  outlined  within  the  context  of  CJ  processes. 

/ As  a  brief  review  (see  also  [2],[3])  and  a  modi- 
fic/Uon  of  past  efforts,  the  following  obtains: 

^T'-The  author  has  been  considering  Cjfyprocesses 
from  the  generic  viewpoint  of  Interacting  nodes  of 
decislotv-hiakerSjOr  complexes  of  such.  These  interact¬ 
ions  or^signals"  may  be  actual  vectors  of  signals  con¬ 
taining  voluntary  or  leaked  information  from  other 
nodes,  friendly  or  hostile,  or  they  may  represent 
fired  weapons,  for  example.  The  nodes  are  relative  in 
size,  but  whether  they  represent  one  or  a  group  of  in¬ 
dividuals,  they  possess  certain  common  characteristics. 
These  Include  a  decision  structure  centering  around  V 
data  fusion  which  contains  detection,  hypotheses  form¬ 
ing  mechanisms,  algorithm  selections,  and  responses 
as  an  output.  The  nodes  also  are  represented  by  cor¬ 
responding  state  vectors  containing  all  pertinent  des¬ 
criptors,  such  as  equations  of  motion  and  location, 
number  of  individuals  or  supplies  and  their  relative 
importance,  damage  levels,  threat  levels,  and  esti- 
nates  and  other  knowledge  of  other  node  states,  friend¬ 
ly  or  adversary. 

Schematically,  the  following  simplified  situa¬ 
tions  hold  as  Figuresl  and  2  show: 
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I  Figure  2.  Internal  Dynamics  of  C3  Processes :SimpHf 

The  basic  evolution  cycle  of  a  typical  node 
is  described  in  the  following  figure: 
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Figure  3.  Basic  Evolution  Cycle  of  a  Node  Oue  to 
_ “Signal"  Processing  and  Response. _ 

The  components  of  a  typical  node  state  are  as 
In  Table  1 : _ 

/threat  LEVEL? 

NOOE  STATE  *  °P  ,TR00PS 

/  \  tO F  UP, l 

NODE  PROPER  f  OP  VP, II 

Pfi0P£R  IMPORTANCE 

SUPPLY  LEVEL 
EQ.  OF  MO. 

STATE  DAMAGE  LEVEL 


KNOWLEDGE 

PART 


ESTIMATES  OF 
OTHER  NODE 
STATES 


j  Table  1.  Components  of  C  Node  States. _ | 

1.2.  Quantitative  aspects. 

The  next  step  following  the  qualitative  scoping- 
out  of  C3  processes,  including  data  fusion,  is  the  de¬ 
termination  of  the  corresponding  quantitative  descript¬ 
ion.  In  effect,  this  entails  choosing  both  an  appropri¬ 
ate  relational  syntax  and  a  numerical/semantic  evalua¬ 
tion  system.  Such  a  pair  is  called  an  algebraic  logic 
description  pair  (ALOP).  The  reader  is, most  likely, 
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familiar  with  the  most  common  ALOP:  probability  lotjic 
(PL)  where  the  appropriate  syntax  is  the  structure  of 
a  boolean  (or  more  strongly,  sigma-)  algebra  R  of  events. 
Here,  the  usual  set  or  logical/propositional  operations 
hold:  unions(u)  or  disjunctions(v) ,  Intersectlons(n)  or 
conjunctlons(A),  complements  cr  negations  (()'),  mater¬ 
ial  Implications  ( ( * ) ’ u( - - )  or  (-)*v(--),  commonly  de¬ 
noted  by--t^,  and  material  double  Implication  or  mater¬ 
ial  or  logical  equivalence  ((•**  ••)S(---»  •), commonly 
denoted  by*«-»<i  ).  For  purposes  of  simplicity  and  be¬ 
cause  the  author  has  propositional  logic  and  Its  ex¬ 
tensions  in  mind,  the  common  notation  used  throughout 
this  paper  will  be  the  logical/propositiona!  inter¬ 
pretations-  but  these  can  all  be  immediately  convert¬ 
ed  to  the  set  notation  counterparts,  where  required. 

The  corresponding  semantic  or  numerical  evaluation  for 
PL  Is  of  course  simply  the  choice  of  a  particular 
(joint)  probability  measure  (either  finitely  additive 
or  countably  additive,  if  need  be)  p:R  [0,1],  the 
last  symbol  denoting  the  unit  'interval .  (See  [1]  and 
[4]  for  background.) 

As  pointed  out  in  [1]  and  elsewhere  ([4],Chpts 
1,  2.2.1),  other  processes  are  also  involved  in  estab¬ 
lishing  an  evaluation  of  a  situation  such  as  that  en¬ 
tailing  <r  and  data  fusion  processes,  besides  the 
choice  of  ALOP.  For  example,  mental  imaging  and  cogni¬ 
tive  processes  play  an  important  role.as  do  natural 
language  formulations,  semiotics,  and  full  formal  lan¬ 
guage  /  formal  theory.  For  simplicity  only  the  latter 
will  be  considered  in  any  detail  prior  to  the  choice 
of  ALOP.  This  sequence  of  knowledge  flow  in  converting 
any  qualitative  description  into  a  quantitative  one 


can  be  summarized  in  the  diagram  in  Figure  4; 
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Figure  4.  Knowledge  Flow  in  Describing  Situations. 

Examples  of  ALOP's  include: 

probability  logic(PL) :(boolean  algebra, prob.  measure) 
fuzzy  logic(FL):(browerian  lattice,  possibility  meas.) 
Oempster-Shafer  logic(OSL) :(boolean  algebra  ,bel ief  ms.) 
classical  logic  (CL):  (boolean  algebra, 0-1  valued  ms.) 
(See  [1]  or  [4]  again  for  further  details.) 

In  the  case  of  C3  processes,  an  improved  full 
formal  language  description  has  been  developed  for  the 
dynamic  evolution'of  a  typical  CJ  node  state  vector 
[5],  replacing  previous  efforts  In  [l]-(3].  The  next 
section  describes  this. 

1.3  Fall  formal  language  description/  theory  for 
!^~nbde  evolutions. 

In  brief,  the  full  formal  language  description 
is  summarized  in  the  following  tables: _ 

EQUAL 11Y  SYM80L:  = 

CONSTANTS:  fi,  e 
OUMMY  YARIA8LES :  a.B.Y 
SPECIFIC  VARIABLES:  N.R.S;  T  IMPLICIT  IN  N 
OPERATORS:  ()\()-,()0.  (  |  ),  4.  v,  00M,  c 

GENERAL  AXIOMS:  FOR  ALL  a.B.y.  ANO  FOR  *  -  4,v: 

RING  STRUCTURE  FOR  4, v: 
a*B  a  B*a  ,  o*(B*y)  *  (a*8)*Y  • 
aSO  «  0,  o4n  *  a  ■  oVO,  avn  ■  fi, 
o4(bvy)  -  (a4B)v(a4Y). 

Table  2a.  Formal  Language  Description  of  a 
_ C_  Node  Evolution:  Part  1. _ 


GENERAL  AXIOMS:  FOR  ALL  o.B.Y.  AND  FOR  *  =  4 ,v 
IMPLICATIVE/CONDITIONAL  STRUCTURE  FOR  4,v: 
(o|n)  *  a  ,  (a|B)  *  (o4b|b)  . 

(aiej y)  *  (oIbAy)A(b|y) , 

(a*8|Y>  *  (<>iy)*(B|y)  , 
vo  *  n  . 
ocDOM(o) 

SUFFICIENCY  AXIOMS:  FOR  R  - 


(R 


Ji+V 


|N+4N) 
4  N+4  N) 


(R+V) 

(N++|R+*i  N+) 


(NAN  4N  S’ 


•4No): 


(N+(S  4  R'S  R)  =  (N+|S  4  N) 

(SlR*4  if)  =  (S|R') 

Table  2b.  Formal  Language  Description'  of  a 
Node  Evolution:  .Part  2. 


The  symbols  in  Table  2  can  be  interpreted  as 
follows, as  given  in  Table  3: 

[  N  •  NODE  STATE  VECTOR  ,  T  ■  NODE  STATE  STRUCTURE 
.  R  •  RESPONSE  VEGTOR  ,  S'-  "SIGNAL"  VECTOR 

I  (  )+  *  POSITIVE  TIME  SHIFT  TO  NEW  PHASE 

(  )‘  *  NEGATIVE  TIME  SHIFT  TO  OLD  PHASE 
(  )0  ■  INITIALIZATION  OF  STATE  (TIME-WISE) 

(  |  )  •  IMPLICATION  OR  CONDITIONING 

4  *  ANO  ,  v  ■  OR  ,  (  )'  «  NOT  (EXPLAINED  EARLIER) 
DOM  *  DOMAIN  OF  POSSIBLE  VALUES 
c  *  SET  MEMBERSHIP  RELATION  AS  USED  BEFORE 

Table  3.  Interpretations  of  the  Formal  Language 
for  Co  Node  Evolution. 


Note  that  N  and  T  above  can  be  partitioned  into 
subvectors  as  e.g. : 

N*  { }WP| , f.i'P., , fWPj , f TROOP ,EQM0, IiTfo)  (1.1) 

T*  (OET.ALG.HYP.FUS, CONS, DEC)  (1.2) 

where  DET«detection  (or  not),  ALG'algorithm  selection, 
KYP*hypotheses  formulation,  FUS,data  fusion  ,DEC‘deci»- 
ion,  etc.  One  can  add  the  constraint  (1.3)  to  the  ax¬ 
ioms  in  Table  2b: 

(R++|T+4  N+)  *  (R+i|DEC+4  N+).  (1.3) 

Using  similar  sufficiency  assumptions,  implicative 
chaining  in  Table  2b  shows  that 

(T+|N+)  *  (DEC4 |C0NS+4FUS+4HYP+AALG+4DET+4N+) 

S(C0NS+ | FUS4AHYP44ALG4ADET+4N+) 

4( FUS+ |HYP+4ALG+40ET+4N+) 

S(HYP+|ALG+4DET+4N+) 

:(ALG+|CET+4N4)4(CET4|N4)  .  (1.4) 

Finally,  applying  the  usual  deduction  procedure 
to  the  axioms  given  in  Table  2,  yields  the  following 
theorem  (1 . 1 jdescribing  the  dynamic  evolution  of  a 
noae  state  in  formal  language  terms: 

Theorem  1.1  (See  (5].) 

Under  the  assumptions  in  Table  2: 

(N++|N)  .((N44|R4+&N4)4(R4+|N4)4(N4|N}) 


V°°H<R  )  (1.5) 

\N  c  OOM(N  ) J 
where  ,  t 

(N  |N)  *  V  ((N  |R  4N)4(R  |K)).  (1.6) 

R'cOOH(R') 

(R4+|N4).  fV  t  ((R4+|tV)4(T4|N4)),  (1.7) 

T  cOOM(T  ) 

(N+|R*4N)  *  V  ((H4|S4N)4(S|r”))  ,  (1.8) 

ScDOM(S) 

N44  -  V  ((N44|N)4  H)  .  l,'9) 

HcOOM(H) 

I 
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Thus,  using  the  interpretation  In  Table  3,  com¬ 
patible  with  Figure  3, 

(R  |T  IN  )  -  response  following  processing,  (1.10) 

(N  |R++4N+)  •  new  node  state  due  to  Its  sending 

out  response  ,  (1.11) 

(T+|N+)  *  processing  data,  (1.12) 

(N  |N)  «  full  cycle  of  node  change  due  to 
"signals"  received,  over  all  poss- 
t  ible  processing,  and  responses.  (1.13) 


Thus,  If  PL  were  chosen  as  the  ALOP,  assuming 
only  stochastic  relations  are  Involved  In  C3  variables, 
then  TheoremU  reduces  to -the  more  familiar  form 


P(N++|N)*  /  p(N++|R++,N+)-p(R++|N+)-p(N+|N)dR++dNt 


VN+cOOM(N+)  / 


(1.14) 


Or,  If  FL  were  chosen  as  the  ALOP,  assuming  only  fuzzy 
relations  are  Involved  In  C3  variables,  then  Theoremll 
becomes  under  semantic  evaluation 


possfN^lN)*  max(  m1n(poss(N++|R++  N+)  ,poss(R++|N+) , 
/overall  ..  \  poss(N*|N))j , 


R^cDOMCR^) 

\N+c00M(N+) 


(1.15) 


One  could  also  choose  combinations  of  PL  and  FL  or 
other  ALDP's  In  the  evaluation  aspect.  (Again,  see  (41) 


In  turn,  utilizing  the  outputs  In  Theorem  1.1, 
together  with  the  choice  of  ALOP,  It  Is  clear  that  the 
evolution  of  node  states  depend  on  the  determination 
of  the  relative  primitive  relations  given  as  suffici¬ 
ency  axioms  In  Table  2b.  Calling  each  possible  combin¬ 
ation  of  such  relations  for  each  C3  side  J, friendly 
(j"l)  or  adversary  (j*2),  PRIMj  ,  one  can  establish 

a  loss  L(PRIMj .PRIM,,)  based  directly  on  Theorem  1.1, 

thereby  establishing  a  zero  sum  two"person"C3  decision 
game  and  then  procede  to  analyze  the  game  for  values, 
least  favorable  strategies,  bayes  decisions,  mtnlmax 
strategies,  etc.  (See  [5]  for  further  details,  where 
a  multidimensional  gausslan  linear  conditional  struc¬ 
ture  Is  Imposed  upon  the  relations  yielding  feasible 
computational  forms.) 


Throughout  all  of  the  above  calculations,  data 
fusion  plays  a  central  role  (see  again  (1.4)  and  (1.7) 
where  the  specific  quantitative  relations  depending 
upon  data  fusion  are  shown).  In  the  next  section,  mo¬ 
tivation  Is  developed  for  a  systematic  approach  to 
the  fusion  proper  aspect  for  disparate  Information  ar¬ 
riving  In  conditional  form. 


2.  NEED  FOR  A  CONDITIONAL  EVENT  ALGEBRA  IN 
EVALUATING  DATA  FUSION 

2.1  Introduction. 

Noting  that  many  of  the  relations  In  Table  2b 
and  subsequent  equations  are  In  conditioned  form,  con¬ 
sider  In  particular  the  basic  data  fusion  factor  In 
(1.4) 

Q  -  (FUS+|HYP+A  ALG+  &  0ET+  4  N+),  (2.1) 

noting  that  the  Incoming  "signal"  S  Is  present  through 
the  change  of  N  to  N  appearing  In  the  antecedent. Fix 
throughout  the  discussion, in  the  antecedent  for  Q,an 
arbitrary  combination  of  possible  domain  values  for 
HVP  ,ALG  .0ET+,  and  N+  and  hence  S,up  to  some  variabll- 
1  ty . 

Consider  then  the  two  following  simplified  ex- 

'amples: 

Q  *  (a|b)  »  (a|c)  ,  (2.2) 

where 

a  •  ship  target  possible  position  area  updated, 
b  *  track  history  1  Is  the  assumed  assignment 
(possibly  In  error)  to  the  target, 
c  •  track  history  2  Is  the  assumed  assignment 
(possibly  In  error)  to  the  target  . 

Or,  perhaps,  Q  represents  Intelligence  Informa¬ 
tion  to  be  fused  by  evaluating  the  truth  of  the  ex¬ 


pression 

Q  *  ((a )b)  &  (c |d) )  v  (e | f ) ,  (2.3) 

where  now 

a  *  a(x)  *  enemy  will  move  up  about  x  troops  to¬ 
morrows  x*0,50,100,150. 

b  •  b(y)  *  It  will  y  tomorrow;  y-be  clear,  snow, rain. 

c  -  c(zj  *  enemy  will  use  Pass  z  to  approach  us; 
z*!, II, III, IV. 

d  *  d(r,s)*  morale  of  enemy  node  17  is  at  level  r 
and  number  of  their  troops  left  Is  s  ; 
r»very  low,  low,  medium, high,  very  high, 
s-0, 100,200, 300. 

e  -  e(w)  *  enemy  will  w  tomorrow;  w*surrender,not 
surrender. 

f  *  f(q)  ■  enemy  overall  damage  level  Is  q  ; 
q*0,1,2,..,10. 

Of  course,  If  the  antecedents  In  (2.2)  or  (2.3) 
were  all  the  same,  then  no  real  problem  would  arise, 
since  for  example  It  Is  readily  justified  that  for  any 
choice  of  ALOP  -  certainly  for  PL  I  -  that 

Q  *  ((a|d)  4  (c |d) )  v  (e|d) 

■  («a4c)v$|d)  ,  (2.4) 

even  though  normally  one  does  not  talk  about  such 
mealure-free  entltleslup'to now).  Indeed,  since  the  goal 
Is  the  evaluation  of  Q,  for  PL,  choosing  a  probability 
measure  p  over  all  the  relevant  events,  one  would  us¬ 
ually  evaluate  Q  as  simply 

p(9>  *  P(((a)d)  4  (eld))  v  ( e | d ) ) 

*  p(((a4c)ve)|d) 

»  p(((a4c)vej)  4d)/p(d) ,  (2.5) 

etc. ,  assuming  p(d)>0. 

But  the  po1'nt"of  the  above  examples  In  (2.2) 
and  (2.3)  Is  that  the  antecedents  In  the  conditional 
forms  are  not  in  general  Identical!  What  to  do? 

Contrary  to  popular  belief  [author's  note:  this 
author  and  his  colleague  Prof.  H.T.  Nguyen,  Hath.  Dept. 
New  Mexico  State  University,  Las  Cruces,  have  undertak¬ 
en  an  extensive  Informal  survey  of  the  probability 
community-  both  applied  and  theoretical -resulting  In 
the  following  conclusions  -  see  also  [7]  ];  there  Is 
no  systematic  and  mathematically  sound  procedure  for 
computing  p(Q)  (or  Q,  for  that  matter)  in  either  (2.2) 
or  (2.3),  or  any  similar  probleml 


Indeed,  there  do  exist  "folk"  remedies  to  this 
situation  which  roughly  speaking  reduce  to  two  ap¬ 
proaches  as  presented  In  the  next  sections. 

2.2  Approach  A:  Identification  of  conditioning 
with  material  Implication. 

In  this  approach,  one  interprets  (a|b)  as  b-»a, 
l.e.,  for  any  a, b, events,  , 

(a|b)  *  b+a  *  b'va  =  b'vfaSb)  (2.6) 

Is  assumed  to  be  valid  so  that  by  the  principle  of 
substitution  relative  to  equality,  for  any  (suitable) 
probability  measure  p,  assuming  the  identity  for  p(b) >0 

p( (a | b) )  ■  p(a|b)  *  p(a4b)/p(b),  (2.7) 

one  has  Immediately  from  (2.6) 
p(a|b)  •  p(b->a) 

«  p(b,v^5b))*l-p(b)+p(a4b),  (2.8) 

etc. 


Thus  using  this  approach,  (2.2)  becomes: 

p(Q)«p((b->a)  v  (o a))*p(b‘vavc'va) 
»p((b4c)'va)*p((b4c),i’a ) 

•p(a|b4c).  (2.9) 


However,  there  Is  just  one  flaw  in  the  above 
reasoning:  One  cannot  make  the  Identification  in  gener¬ 
al  In  the  left  hand  side  of  (2.6).  Indeed,  It  is  rather 
easy  to  show  (yet  surprisingly  few  are  aware  of  the 
inequality  below-  see  e.g.  the  discussion  in  [7],  sect. 
1.8): 


p(b->a)  *  p(a  b)  ♦  p(a *  |b) - p(b* ) 
a  p(a  b) 
a  p(aib)  > 


(2.10) 
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where  In  general  strict  inequality  holds  for  the  last  , 
two  z.  Furthermore,  (2‘. 6)  is  not  even  a  good  approxi¬ 
mation, since  it  is  readily  verified  for  b  with  p(b) 
small  that  one  can  choose  a  and  b  such  that  p(b->a)  is 
close  to  one,while  p(a|b)  is  close  to  zero.  This  un¬ 
fortunate  situation  is  a  special  case  of  the  "Stalnaker 
Thesis"  problem  and  is  considered  in  detail  in  [6]  and 
[7],  section  1.  In  fact  the  following  apparently  not- 
well- known  result  has  been  shown: 

Theorem  2.1.  (P.  Calabrese  [8],  section  1.2) 

Let  R  be  a  boolean  algebra  of  events  with  the 
usual  operations  discussed  previously.  Let  p  be  any 
non-degenerate  probability  measure  over  R,1.e. 
p:R  -  [0,1].  Then,  there  is  no  binary  boolean  function 
f:R2  *  R  such  that  for  all  aTB-  e  R  ,  with  p(b)>0, 

p(a|b)  »  p(f(a,b)).  (2.11) 

I 

The  result  is  further  extended  In  one  direction 
by  the  following  result: 

Theorem  2.2.  (  Goodman  A  Nguyen  [7],  Theorem  2.7) 

Let  R  be  any  finite  boolean  algebra  of  events. 
Then,  there  is  no  binary  function  f  of  any  kind,f  :R2-*r, 
such  that  for  all  a,b  e  R,  with  p(b)>0,  (2.11)  holds. 

I 

However,  by  allowing  infinite  boolean  algebras 
one  can  force  a  form  of  conditioning  to  be  back  in  the 
original  boolean  algebra  (but  not  without  complication) 
as  Copeland  showed.  (For  a  critique  of  Copeland's  “im¬ 
plicative"  boolean  algebras,  see  [7],  section  1.8.) 

2.3  Approach  B:  Identification  of  conditional  events 
as.  marginal  ones  with  connion  joint  antecFdents. 

In  this  approach,  one  attempts  to  obtain  a  com¬ 
mon  joint  antecedent  event  for  all  of  the  conditional 
events  appearing  and  then  identify  each  as  a  marginal 
one  having  a  cocmon  joint  antecedent.  In  turn,  one 
procedes  to  evaluate  for  a  suitably  chosen  probability 
measure  analogous  to  that  In  (2.5).  This  is  best  shown 
through  an  application  to  (2.3): 

First  make  the  identifications 

(a|b)  with  (axdxf|G)l  j 

(cidj  with  (bxcxf|6)V;G  *  bxdxf.  (2.12) 

(e | f )  with  (bxdxe|G)J 

Then  (2.3)  becomes 

Q  =((axdxf[G)  A  (bxcxf |G) )  v  (bxdxe|G) 

>  (((aib  x  cAd  x  f)  v(bxdxe)) |G)  ,  (2.13) 


Thus  one  is  lead  to  question  whether  any  remedy 
exists  for  this  situation:  Can  a  calculus  of  measure- 
free  conditional  events  be  developed  which  is  both 
compatible  with  ordinary  conditional  probability  eval¬ 
uations  and  is  also  unambiguous  and  feasible  TO  imple¬ 
ment, as  well  as  being  based  upon  sound,  non-ad  hoc 
mathematical  principles?  Certainly,  all  evaluation  of 
fused  data,  and  hence  evaluations  for  the  overall  c3 
problem,  must  depend,  in  effect,  on  the  outcome  of  thi. 
question. 

It  is  the  contention  here  that  the  answer  to  the 
above  question  is  definitely  In  the  affirmative.  In 
this  paper  in  section  3  an  outline  of  a  theory  for  de¬ 
veloping  such  a  calculus  of  operations  and  related 
Issues  is  presented.  This  is  carried  out  for  not  only 
the  purpose  of  keeping  this  paper  as  self-contained 
as  possible,  but  also  because  of  the  desire  to  dis¬ 
seminate  these  novel  and  universally  applicable  re¬ 
sults  to  as  wide  an  audience  as  possible,  uithin  a 
short  time  period.  For  earlier  efforts  in  this  direct¬ 
ion,  see  [6].  In  [7](  in  the  process  of  being  subiitted 
for  publication)  the  full  theory,  with  all  proofs,  is 
exhibited. 

One  consequence  of  the  calculus  of  conditional 
events  is  that  the  evaluations  for  Q  in  (2.2)  and  (2.3) 
become  rather  simple.  Thus,  It  will  be  shown  that 
(2.2)  yields 

Q  *  ((aA(bvc)|(aA(bvc))v(bAc))  (2.16) 

so  that 

-  p(q)  *  p(aA(bvc))/p((aA(bvc))v{bAc)) ,(2.17) 
etc.,  differing  considerably  from  that  proposed  by 


Approaches  A  (see  (2.9))  or  B. 

For  (2.3),  one  obtains 

Q  *  (ojlf)  (2.18) 

resulting  in 

P(Q)  *  p(o)/p(B).  (2.19) 

Where  a  *  (aAbAcAd)  v  (eAf)  ,  (2.20) 

B  •  o  v  (1(a'Ab)v(c'Ad)v(bAd))Af) ,  (2.21) 


differing  again  considerably  from  both  Approaches  A 
and  B  (see  (2.13)). 

In  all  of  the  above  computations,  one  need  not 
construct  joint  probability  measures  and  consider  car¬ 
tesian  products  of  events,  nor  is  the  procedure  ad  hoc 

(despite  the  oversimplified  appeal  of  Approach  A  -  but 
see  section  4 W). 

3.  OUTLINE  OF  A  THEORY  OF  HEASURE-FREE  CONDITIONAL 
EVENTS 


resulting  in  the  evaluation 


3.1  Introduction. 


p(Q)  *  p^(aAb  x  cAd  x  f)  v  (bxdxe)  |  G)  ,  (2.14) 

which  can  be  further  reduced  using  the  definition  of 
conditional  probability  and  the  standard  calculus  of 
operations  for  PL. * 


However,  the  main  drawback  to  this  approach  is 
that  initial  probability  measure  p:R  •»  [0,1]  must  be 
replaced  by  some  joint  probability  measure  p  over  the 
boolean  (or  sigma)  algebra  spanned  by  R3,  where 
p(-lb),p(-.|d),p(...|f):R  -*  [0,1]  are  conditional  prob¬ 
ability  measures  whose  Joint  measure  is  pQlso  that 

p(a|b)»p  (axdxf|G),p(c|d)*p  (bxcxf |G),p{e|f)«p(b«fxel!) 

0  0  °(2.15) 

8ut  what  choice  of  p  to  make?  Should  it  be  based  on 
maximal  entropy  considerations,  etc.?  Long  calculations 
can  also  result  from  the  cartesian  product  forms. (For 
further  discussion,  see  [7],  sections  1.1,  1.5,  and 
10. A.  However,  for  a  tie-in  with  the  approach  presented 
in  this  paper.  Theorem  4.1  given  in  section  4  Is  ot  use.) 


2.4 


The  basic  problem  In  representing  conditional 
events  with  distinct  antecedents. 


As  Shown  in  “ction  2.3  two  of  the  most  common 
approaches  to  the  handling  of  conditional  events  do 
not  lead  to  satisfactory  results,  from  either  a  math¬ 
ematical  vievooint.as  in  Approach  A, or  an  unambiguous 
computationally  efficient  viewpoint, as  in  Approach  B. 


Following  the  basic  motivation  for  the  develop¬ 
ment  of  a  conditional  event  calculus  for  PL  In  section 
2,  this  section  presents  an  overview  of  the  basic  re¬ 
sults.  The  following  three  questions  are  addressed: 

(i)  What  meaning  can  be  attached  to  a  typical 
conditional  event  (a|b),  where  a  and  b  are  ordinary 
unconditional  events,  prior  to  evaluating  through  a 
specific  probability  measure  p  to  become  (for  p(b)>0) 

p( (a |b) )  =  p(a|b)  ■  p(aAb)/p(b)  ?  (3.1) 

(ii)  How  shall  operations-  in  particular,  the 
usual  boolean  ope-ations  A , v , ( ) '  and  relations  such  as 
s  -  be  extended  from  unconditional  events  to  condition¬ 
al  ones  and  what  properties  do  they  possess? 

(iii)  Can  such  operations  and  relations  as  in  (ii) 
be  characterized  for  uniqueness,  etc.  ? 

For  a  history  of  previous  attempts  at  develop¬ 
ing  a  theory  of  measure-free  conditioning,  see  [7], 
sections  1.8  and  1.9.  Among  the  predecessors  of  this 
effort,  Schay  [9]  was  among  the  first  to  attempt  such 
a  task,  but  used  an  ad  hoc  procedure  in  addressing 
question  (ii),  although  a  somewhat  complicated  charact¬ 
erization  was  developed  relative  to  (iii).  Later, 
Calabrese,  completely  independent  of  Schay,  produced 
also  an  algebra  of  conditional  events  and  operations. 
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the  latter  also  from  an  ad  hoc  approach  following  cert¬ 
ain  analogies  with  material  implication  [8]. 

3.2  Development  of  measure-free  conditional  events. 

From  now  on,  without  further  explanation,  the 
symbol  R  refers  to  an  arbitrary  fixed  boolean  algebra 
with  all  of  the  usual  operations  and  relations  explain¬ 
ed  previously  (see  section  1.2).  The  partial  order 
i  over  R2  (corresponding  to  the  subset  relation  z 
among  sets  corresponding  to  events  or  propositions 
as  considered  here)  Is  defined  as  usual  as 

asb  Iff  a  *  aSb  iff  b  •  avb,  (3.2) 

for  any  (unconditional)  events  a,b  e  R.  Note  also,  9 
denotes  the  null  event  and  n  the  universal  (unity)event. 

Oeflne  If-S)  to  be  any  candidate  elate  of  con¬ 
ditional  events  extending  R  iff.f  is  some  function 
f:R2  S  for  some  space  S.such  that  for  all  a,b,c  e 
R,  and  boolean  operations  »  over  R:  *.  .etc.  are  oper¬ 
ations  over  (assumed  )  boolean  algebra  of  events 
Sb  4  f('.b)(R)  *  range(f(-,b)) 

where 


f(a,b).bf(c,b)  >  f(a*c,b), 
and 

f(a,b)  •  f(aib,b)  ,  f(a,n)  *  a  • 

For  any  candidate  class  (f.S),  one  can  Interpret 
f(a,b)  as  a  conditioned  upon  b  wrt  f"or  symbolically 
as  (a|b)f,  where  a  is  the  consequent  and  b  the  ante¬ 
cedent.  f 

Theorem  3.1, ([7],  Theorem  2.1) 

(I)  (nat.R)  Is  a  candidate  class  of  conditional 
events  extending  R,  called  the  canonical  close  of 
conditional  events  extending  R,  where  in  C3.+) 

Rb  i  «a|b)nit:  a  «  *  >  •  <3-7> 

where  for  each  a,b  e  R, 

(a ]b)  $  (a|b)nat  -(Rib' )v(a4b) 

•  {(xib')v(aib):  xcR)  (3.8) 

Is  the  principal  Ideal  coset  (Rib1  being  the  princi¬ 
pal  Ideal)  generated  by  b'  with  residue  a&b.  making 
R^  a  boolean  quotient  algebra  with  the  usual  coset 

operations  ;b  corresponding  to  ordinary  boolean  oper¬ 
ations  *  over  R  (thus,  *  ■  &,»,()', etc.). 

r4  U  R  .  {(a|b) :  a.b  e  R)  (3.9) 

bcR 

and  for  any  a,b  c  R, 

nat(a.b)  *  (a|b).  (3.10) 

(II)  For  each  a.b  c  R.  noting  (a|b)  £  R.  (alb)  Is 
the  Inverse  of  the  conjunction  operation  (•SbJ:R+R  at 
a&b,  1 . e. . 

(a|6)  *  (y:  yeR  and  y&b  ■  a&b).  (3.11) 

Equivalently,  (a|b)  Is  the  largest  subclass  of  R  sat¬ 
isfying  the  relation 

(a|b)ib  «  a&b  (3.12) 

(lit)  For  any  candidate  class  (f.S)  of  conditional 
events  extending  R,  and  each  bcR, 

Sb(*b.vb>0‘b)Rj)R/f'1(’ .b)  (boolean  quot.alg.) 

2  Rb(5b.vb,Orb)  .  (3.13) 

the  symbol ».  denoting  an  Isomorphism,  so  that  in  the 
above  local  sense  for  each  b,  the  canonical  class  of 
conditional  events  Is  the  smallest  possible  candidate 
class  of  conditional  events  extending  R.  ! 

Note  also  that  for  any  a.b.c.d  c  R, 

(a | b)  *  (c|d)  iff  aib  =  c&d  and  b  *  d  .  (3.14) 

but  unlike  the  classical  case  where  b'd,  (ajb)  is  not 
necessarily  identical  nor  disjoint  from  (c|d).  (See 
[7] ,  Theorem  2.11)  Note  also  the  relations 


(3.3) 

(3.4) 

(3.5) 

(3.6) 


R  £  R  c  p(R), 


(3.15) 


where  p(R)  denotes  the  power  class,  or  class  of  all 
subsets  of  elements  ,  of  R. 

Next,  call  any  pair  (f.S)  (  not-necessarily. 
a  priori  a  candidate  class  of  conditional  events) 
where  f:R2-*S  Is  surjective  (i.e. ,  onto)  a  probability- 
compatible  pair  with  respect  to  R  Iff,  by  definition , 


R  £  S  «  u  Sh 
beR 


(3.16) 


where  now  Sb  Is  some  boolean  algebra,  for  each  bcR, 


and  where  for  each  probability  measure  p:R-*fO,l]  and 
each  beR  with  p(b)>0,  p  can  be  extended  to  (using  the 
same  symbol)  p:S-»[0,l]  such  that  for  all  aeR. 


p(f(a,b))  ■  p(a|b).  (3.17) 


Theorem  3.2.  ([7],  Theorems  2. 5,-2. 9) 

Let  (f.S)  be  a  probability-compatible  pair 
with  respect  R.  Then: 

(I)  (f.S)  Is  also  acandlaate  class  of  conditional 
events  extending  R. 

(II)  (nat.R)  Is  a  probability-compatible  pair. 

(III)  By  suitable  restriction  of  f:R2  *S  to  non¬ 
trivial , I.e. ,  non-tero  or  non-unity  probability-valued 
conditional  event  pairs,  then  :  f  becomes  bljectlve 
and  ^  In  (3.13)  can  be  replaced  by  a  global  Isomor¬ 
phism  ~  not  dependent  upon  b,  showlng^that  the  canon¬ 
ical  class  of  conditional  events  (nat.R)  is  the  uni¬ 
versally  minimal  (wet.  subclass  Inclusion)  probability- 
compatible  candidate  class  of  conditional  events  ex¬ 
tending  R. 

I 

Next,  a  basic  logical  justification  for  choos¬ 
ing  the  canonical  conditional  events  Is  given.  First, 
for  any  a.b  c  R,  define  the  class  of  all  e-relative 
deducts  of  b  as 

(alb)-  ■  (x:  xcR  and  there  exists  rcR  with  rib 

and  x&r  *  air  )  (3.18) 

(Calabrese  [8],  motivated  by  classical  logic  deduction, 
proposed  this  definition  previously  for  conditioning 
a  by  b. ) 

Theorem  3.3,  ([7],  Theorem  1.3) 

For  all  a.b  c  R, 

(a|bh  *  (a|b),  (3.19) 

I.e.,  R  coincides  with  the  class  of  all  relative  de¬ 
ducts! 

I 


3.3  Calculus  of  operations  on  conditional  events. 

Vlth  the  role  of  the  canonical  class  of  condit¬ 
ional  events  firmly  established  In  section  3.2,  consid¬ 
er  now  the  choice  of  operations  upon  them  extending 
the  usual  boolean  operations  acting  upon  unconditional 
events.  Throughout  all  of  real  analysis  and  topology, 
a  universal  way  of  extending  a  given  “point"-valued 
function  to  a  ”set“-va1ued  one  Is  simply  through  the 
natural  extension  or, equivalently,  called  the  compon- 
ent-wiee  class  or  image  extension.  In  particular,  let 
9:R2  •*  R  be  any  binary  operation  (boolean  or  otherwise) 
upon  R  (unary  and  more  generally,  n-ary  operations  can 
be  treated  similarly).  Then  the  natural  extension  (also 
denoted  by  the  same  symtcl  for  g)  from  g  over  R2  to 
g:P(R)2  -  p(R),  I.e.,  over  p(R)x,1s  determined  by, 

g(A,8)  »  (g(a,b):  acA,  bcB),  (3.20) 
for  any  A.B  £  R  .i.e.,  A, 8  c  P(R). 

Thus,  recalling  the  comments  In  Theorem  3.1(H) 
and  (3.15),  it  is  basic  to  Inquire  what  forms  the 
natural  extensions  take  for  the  ordinary  ^boolean  oper¬ 
ations  relative  to  R  when  restricted  to  R.  Note  that 
for  the  binary  operations  &,v:R2  -  R  ,  by  their  com¬ 
mutativity  and  associativity;  they  extend  recursively 
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and  unambiguously  to  *  R,  where,  by  convention, 

for  n«l,  4  *  v  "identity  function. (The  unary  negation 
or  complement  operator  ()' :R  ■*  R  remains  as  Is.) 

Denote  the  natural  extensions  of  4,v,()'  by  the  same 
symbols.  Thus^here  the  behavior  of  the  natural  exten¬ 
sions  of  4,v:Rn  +-R  to  the  restrictions  4,v:r1  -►  p{R) 

and  that  of  ()':R  +  R  to  the  restriction  ()':R  •»  p(R) 
are  sought. 


Theorem  3.4,  ([7],-  '"iipllarles  3. 3,3. 4) 

Fo-any  positive  Integer  n  and  any  a.,b,  c  R, 
1-1. ...n:  4  4 

(1)  The  common  antecedent  case,  noting  £  K. 

(a|b)^(a|b)Jv  -  (a’jb)  *  (a'&bjb),  (3.21) 

»  (a.|b)  *  *.  (a.|b)  »  (  2  a . (b)-(  2  a,jb|b),  (3.22) 

1*1  4  j.i  4  1-1  4  1-1  4 

for  »  *  4,v. 

Thus,  relative  to  any  given  boolean  quotient 
algebra  of  the  form  R. , al  1  coset  operations  and  cor¬ 
responding  natural  extensions  of  the  original  opera¬ 
tions  relative  to  R  coincide.  It  follows  that  If 
g:R“  •*  R  Is  any  (compound)  boolean  operation,  then 


g((a1|b1),...(an|bn))-g^(a1|b1)...,(an|bn)) 

•  (g(ar..,an)|b).  (3.23) 

(11)  Olstlnct  antecedents,! n  general, case, 
n  n  n 


where 


i(»,|b.)  ■  (  4  a.|r)  -  (  4(a,4b.)|r).  (3.24) 

J-l  44  J-1  4  j-l  4  4 

r  -  4  b.  v  v(a'.4b  )*  4(a  4b.)  v  v(a' 4b.) 
1-1  4  J")  4  4  1*1  4  4  1*1  4  4 


and 


(3.25) 


where 


v(a.|b.)  »  (  v  a.|q)  *  (  v(a.4b  )|q),  (3.26) 

1-1  44  1-1  4  1-1  4  4 


*  v(a,4b  )  v  4b,-  v(a,4b  )  v  4(a'.4b.). 

J-l  44  J»1  J  j-l  44  j-l  4  4 

(3.27) 


Combining  (3.24)  and  (3.26),  leads  to  the  fol¬ 
lowing  corollary: 


Corollary  3.1  (.'few  result. ) 

Noting  that  any  (compound  boolean  function  of 
multiple  arguments  can  always  be  put  Into  an  equival¬ 
ent  form  consisting  of  a  disjunction  of  conjunctions, 
let  c  R.1-1 ...  ,m,J-l ...  ,n,  where  some  of  these 

events  may  be  •  or  0  .  Then 

■  n 


where 


v  i  ^al  1  lbTi4  ’  (  ®  I  6  )• 

1*1  j-l 

d  m  n  , 

a  ~  V  4(a  ,4  b,.)  ,  8  *  a  +  y 
1-1  j-l 


Y  •  4  v(a*  4bj .)  , 
j-l  1-1  ,J  u 

noting  that  a  and  y  are  disjoint,  i.e., 
o  4  y  -  9  . 

so  that  for  any  probability  measure  p:R  •*  [0,1], 

A  m  n 

p(  v  }  (a|j  lt>1j>)'*P(«|e)"P(<x)/pCB)‘l/(l  +(p(-r)/p(<a))] 


(3.28) 

0.29) 

(3.30) 

(3.31) 


1*1  j-l 


(3.32) 

I 


Theorem  3.6.  Some  special  cases  ([7],  section  4.2). 

For  any  a,b,c,d,af  c  R,  1*1...  ,n: 

(a|n)-a,  (a|»)-R,  (»|b)-(b* |b)-R4b’-{x4b' :  xcR},(3.33) 
(fl|b)“(b|b)mRvb'  «{xvb‘ :  xcR),  (3.34) 

(a|b)4(c|d)*(a4b4c4d|(a,4b)v(c'4d)v(b5d)) 


»(a6b4c4d|(a’4b)v(c,4d)v(a4b4c6d)),(3.35) 

(a|b)v(c|d)-((a6b)v(c6d)|(a6b)v(c6d)v(b4d)) 

-((a6b)v(c6d)|(a6b)v(c4d)v(a'6b4e46d)), 

(3.36) 


(a|b5-(a4b|b).(b-»a|b)-(l^a)6(b(b).((b'(*,)va)4(b|b)  . 

(3.37) 

(a|b)4b-a4b  ,  (a|b)vb«(b|b).  (3.38) 

(a(b)v(bla)-(a4b|a4b),  (a|b)4(bja)»(a4b|avb),  (3.39) 

(a |b)v(c[b' )-( (a4b)v(c4b' ) | (a4b)v(c4b' ))j3.40) 
(a|b)4(c|b')-(»|(a'.4b)v(c'4b’)),  (3.41) 

(c|d)^(a|b)  *(c-*a|(c'4d)v(a4b)v(b4d)),  (3.42) 
(c  d)»(a|b)*(c^a|b4d),  (3.43) 

chaining:!  (iiblc)  *(»lb&c)*(b|c),  (3.44) 

t(a4b4e|d)  -(a|b8c4d)4(bjc6d)4(c|d),  (3.45) 

8ayes*  Thm:  (a^b)  -((b|aj)4ai  |jSi((b|aj)*a^)),(3.46) 

provided  that  . n 

b  £  v  a.  ,  (3.47) 

1-1  4 

where  above, material  Implication  and  material  double 
Implication's  extended  from  R  to  R,ans defined  formal¬ 
ly  the  same  as  in  tJhe  unconditional  case:  ‘ 

(c|d)  *(a|b)  i  (c|d)*v(a|b),  (3.48) 

(c|d)  H(a|b)  -((c|d)*(a|  b))4(  (a|b)*(e|d)#3.49) 


Recalling  the  partial  order  s  for  R  (see  (3.2)), 
define  and  extend  this  relation  to  R  by  letting,  for 
all  a,b,c,d  c  R,  •  - 

(a|b)  i  (c Id)  iff  (a | b }  -  (a|b)4(c|d).  (3.50) 

Theorem  3.7.  ([7],  Theorems  4. 1,4. 7) 

For  all  a,b,c,d  6  R: 

(I)  Characterization  of  s  over  R  : 

(a | b)  s  (c|d)  If;?  (c|d)  -  (a|b)v(c|d) 

jff(a4b)s  (:4d)  and(b-wa)s(d*»c) 
jiff  (a4b)s(c4d)  and  ,{c'4d)s(a‘4b) 
iff  (c|d)’  s  (a|b)‘.  (3.51) 

(II)  s  over  R2  Is  not  only  a  partial  order  (reflex¬ 
ive,  transitive,  anti-symmetric),  but  also  a  meet  (.1) 
and  joln(v)  lattice  with  all  of  the  usual  operation¬ 
preserving'  properties.  Note  the  relation,  compatible 
with  (2.10)  and  (3.8),  showing  that  b+a  and  a4b  are 
the  largest  and  smallest  elements  In  (a |b),  respect¬ 
ively,  relative  to  partial  order  s  : 

a4b  s  (a|b)  s  tm  .  (3.52) 

(ill)  R(4,vf()';s)  Is  a  distributive  lattice  which  is 
also  an  algebraic  semi-ring  with  zero  element  3  and 
unity  element  n,  and  Is,  further,  idempotent,  absorb¬ 
ing,  and  demorgan,  among  other  properties. 

I 


3.4  Justifications  for  chglce  of  extensions  o£ 
operations  from~!<rto~K. 

In  addition  to  the  Urge  number  of  desirable 
properties’  for  the  naturally  extended  boolean  opera¬ 
tions  upon  R  given  in  section  3.3,  characterizations 
can  also  be  established. 

Recalling  the  maximality  property  of  b*>a  with 
respect  to  (a|b)  ((3.52)),  define  a  corresponding 
mapping  ♦’:£  ■*  R,  where  for  any  a,b  c  R, 

♦  ((a|b))  *  b-»a.  (3.53) 

Theorem  3.8.  ([7],  Theorem  10.1,  Remark  10.1) 

(I)  $  is  a  surjective  4,v-homomorphism  with  respect 
to  the  natural  extensions  of  4,v  from  R  to  R. 

(II)  Let  4,v:R2  ♦  R  be  any  possible  extensions  of 
4,v:R2  -*■  R,  respectively,  such  that  there  exist 
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functions  ,<»2 :R**  -►  R,  where  for  all  a,b,c,d  e  R, 

a  4b  v  cSd  s  *,(a,b,c,d),  aibScid  s  (a.b.c.d) 

2  1  (3.54) 

and 

(a |b)&(c (d)  >  (a4b4c6d|^(a,b,c,d)),  (3.55) 

(a|b)v(c|d)  «  ((a4b)v(cid)|*2(a,b,c,d)),  (3.56) 

noting  the  essential  necessity  of  consequences  matching 
the  corresponding  ones  for  the  natural  extensions. 

Then  it  follows  that  relative  to  8, 

4  «  4  ,  v  »  v  .  (3.57) 

(ill)  Compatible  with  Theorems  2.2,  3.1_,3.2,  there 
Is  m>  full  (l.e,  4,v,()'-)homomorph1sm  p:R  *  R  with 
respect  to  the  natural  extensions  of  4,v,()'  from  R 
to  R  .  , 

Theorem  3.9.  Partial  converse  of  Theorem  3.8. 

([7], Theorem  10.2,  Corollary  10.1 , 

Remark  10.2) 

-  „2 

Let  4,7 :R  *  R  be  any  possible^extenslons  of 
the  corresponding  coset  operations  \,\:2b  *  ^b* 

ultaneously  ang  consistently  for  all  b  e  R.  (Hence, 
necessarily  ,  4,v  extend  4,v  relative  to  R.) 

Suppose  also  that  4,v  obey  not  only  closure, 
but  are  also  commutative  and  associative  over  R  with 
0  and  n  playing  the  usual  roles  of  zero  and  unity  el¬ 
ements,  respectively.  Suppose  also  there  exists 
q>.  :R**  *  R  such  that  f°r  4l  1  a,b,c,d  c  R, 

(a|b)4(c|d)  *  (a4b4c4d|*1(a,b,c,d))  ,  (3.58) 

(a|b)v(c|d)  *  ((a4b)v(c4d)|t2(a,b,c,d)),  (3.59) 

(a|b)4b  •  a4b  ,  (3.60) 

and 

(  (a|b)tc  c  R  )  Implies  csb.  (3.61) 

Then 

(1)  For  all  a.b.c.d  c  R, 

(a‘4b)v(c'4d)v(bSd)  s  ^(a.b.c.d),  (3.62) 

(a4b)v(c4d)v(b6d)  s  *2(a,b,c,d),  (3.63) 

showing  that  the  natural  extensions  of  4,v  are  maximal, 
i-e"  (a|b)4(c|d)  s  (a|b)4(c|d),  (3.64) 

(a|b)v(c|d)  <  (a|b)v(c|d).  (3.65) 

(il)  Result  (1)  shows  that  In  contradistinction  to 
the  antecedent-only  dependent  operations  of  Schay  [9] 
and  Calabrese  [8],  there  are  no  boolean  functions 

as  above,but  now  such  that  for  all  a,b,c,d  e  R, 
^j(a,b,c,d)*^(b,d)  only,  j*l  ,2, such  that  the  corres¬ 
ponding  operations  4  and  v  satisfy  the  hypotheses  of 
this  theorem.  ^ 

3.5  Additional  properties  of  R. 

Finally,  brief  mention  should  be  made  of  other 
pertinent  properties  of  the  conditional  extension  of 
a  given  boolean  algebra  of  events. 

(i)  Stone's  Representation  Theorem  -  showing  an 
order-preserving  isomorphism  always  exists  between  a 
given  boolean  algebra  R  of  events  or  propositions 
and  a  corresponding  boolean  algebra  of  subsets  of 
some  set- can  be  extended  quite  readily  to  R  ([7], 
Theorem  10.3). 

(<i)  The  usual  Hllbert-Ackermann  axioms  involving 
material  impl fcatfon, relative  to  any  R,  wher.  R  Is  re¬ 
placed  by  R,  ordinary  substitution,  and  a  modified 
form  of  modus  ponens  used  to  deduce  theorems  from  pre¬ 
vious  theorems  and  axioms,  together  with  the  natural 
extensions  of  all  boolean  operations  from  R  to  R, 
forms  a_ sound  and  complete  logic,  l.e.,  all  theorems 
are  tautologies  and  vice-versa,  Callthls  conditional 
probability  logic  (CPL),  extending  ordinary  probabili¬ 
ty  logic  (PL).  (See  T7).  Corollary  9.1.)  Here, for. any 
a,b  c  R,  (a|b)  is  a  tautology  for  CPL,  written  ■  talb) , 
iff,  by  definition,  CPL 


p(*|b)  *  1 ,  (3.66) 

for  all  probability  measures  p:R  ■*  [0,1],  with  p(b)>0. 

From  [7],  sections  9.4,  9.5,  2.5;  the  following 
concepts  and  results  hold,  for  any  a.b.c.d  c  R: 

(3.67). 

u)  f-  (a|b)  fff  bsa  Iff  b-*a  *  1  jff  (a|b)*(b|b). 

CPL 

(**)}—  (a|b)  and  J-  (b|a))iff-4*b  Iff  ae»b  »1 

CPL  CPL  Iff  (a|b).(a|a)-(b|b). (3.68) 

(III)  Define  (c|d)  tautologically  implies  (a|b)  iff 

^L((e|dMa|b)).  (3.69) 

Then  .  ((c|d)->(a|b))  Iff  b4c4d  s  a  iff  c4d  s  b-»a. 

CPL  (3.70) 

(IV)  Define  (c|d)  tautologically  is  equivalent  to 

a  I  b)  Ilf  ((c|dM»|b)).  (3.71) 

CPL 

Then  h  ((c|d)«*(a|b))  ]ff  b4d  s  (a4b<-*e4d).  (3.72) 
CPL 

(V)  (c|d)s(a|b)  Implies  h  ( (c |d)-»(a Jb) ).  (3.73) 

CPL 

(c | d) »(a | b)  Implies  |“  ((c|d)<-*(a|b)),  (3.74) 

CPL 

(VII)  Sufficient  conditions  for  modus  ponens  analogue: 

-  (c|d)s(a|b)  and  |-  (c|d)  Implies  |- (a|b),(3.75) 

CPL  CPL 

(VIII)  Characterization  of  modus  ponens  analogue: 

(  h-((c|d)-*(a|  b))  and  f—  (c |d) ) 

CPL  .  -  (3.76) 

iff  F|-(a6c|b4d)  and  )-  (c|d)  ). 

CPL  CPL 

(IX)  h  ((a|b)«(c|d))  implies 

CPL  .  (3.77) 

(  |-  ((a|b)-*(c|d))  and  f-  ((c|d)*(a|  b))), 

CPL  CPL 

(X)  Next,  define  (c|d)eemantieaI7i/(or  uniformly  in 
probability)  implies  (a|b),  written  (c|d)  -  (a|b)  , 

Iff  CPL 

—  p(c|d)  s  p(alb),  (3.78) 

for  all  probability  measures  p:R  ■»  [0,1]  with  p(b), 
p(d)>0. 

Also,  define  any  (a|b)  to  be  a  contradiction 
for  CPL,  written  (a|b)  ,  Iff  for  all  probability 
CPL 

measures  p : R  -  [0,1],  with  p(b)>0, 

p(al b)  •  0.  (3.79) 

It  readily  follows  that 

U-  (alb)  Uf  a4b  *  0  jff  |—  (a |b) * .  (3.80) 

CPL  CPL 

With  a  bit  more  difficulty,  one  can  show  ^  g.j 

(c|d)  (a|b)  Uf(  [-  (a |b)  or(/  (c|d)  or  (c|d)s(a|b)) 

CPL  CPL  CPL 

(XI)  Call  (alb)  and  (c|d)  semantically  (or  uniformly 
In  probability)  equivalent,  written  (c|d)  —  (a|b),  iff 

CPL 

p(a|b)  •  p(c|d).  (3.82) 

for  all  probability  measures  p:R  ~  [0,1]  with  p(b), 
p(d)>0. 

It  follows  that 

(c (d)  —  (a (b)  iff  (()-  (a  lb)  and  (c  jd) )  or 
CPL  CPL  CPL 

(  hf  (a|b)  and  (c|d))  or 
CPL  CPL 

(a|b)  *  (c|d)).  (3.83) 

(XII)  Finally,  mention  can  be  made  of  a  weaker  form 
of  semantic  implication  by  restricting  probabilities 
in  the  above  definitions  to  subclasses  or  even  to  a 
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single  probability  measure. 

(Ill)  Another  area  of  basic  Interest  concerns  higher 
order  conditioning.  Thus, If  beginning  with  uncondition¬ 
al  events  say  a,b,c,d  c  R  .  it  is  meaningful  to  consid¬ 
er  the  conditional  events  (a|b),  (c|d),  then  why  should 
one  not  conslder.ln  turn.the  second  order  conditional 
event  ( (a jb) | (c |d) )  7  (This  Issue  is  addressed  In  [7], 
section  5  in  some  detail.)  Basically,  the  appropriate 
definition  for  the  above  expression  Is  the  formal  high¬ 
er  order  analogue  of  (3.11).  Thus  ^  ^ 

{ (a |b)  | (c |d)}  -  {(x|y):(x|y)cR,(x|y)i(c|d)"(a  |b)4(cjd)) 

One  major  result  ([7],  Theorem  5.5)  concerns 
the  class  union  mapping  u:f[f(J))  -  P(R),  where  for 
any  a  S  P(R),  d 

u((S)  *  (x:  xcAcflJ  ,  for  any  A e£P  ).(3.85) 

Noting  that  u  Is  a  surjective  homomorphism  relative  to 
all  natural  extensions  of  operations  from  p(R)  to 
p[p(R)),  not  Just  boolean  operations,  and  noting  that 
all  boolean  operations  over  K  (eP(R)j  car.  be  extended 
to  F (5)  (sp(p(r) ) )  In  the  natural  sense,  though  unlike 
the  first  order  case,  R,  closure  problems  arise  for 
the  higher  order  case,  the  following  reduction  holds: 

u(((a|b)|(c|d)))  -  (a|bA((a'Ad')v(cAd))  .  (3.86) 

for  all  a,b,c,d  e  R.  In  particular, 

u(((a|b)|c)  *  u( ( (a |b) | (c | b) ) )  *  (a|b4c).  (3.87) 

Thus,  through  the  above  relations.  In  a  sense, 
one  need  never  consider  higher  order  conditioning. 

(1v)  One  can  establish  optimal  approximations  of 
arbitrary  subclasses  of  R  through  conditional  events, 
a. .  If  A£  R  ,  the  beat  upper  approximation  of  A 
zhrough  R  satisfies  the  relation  ([7],  section  6) 

A  e  cond(A)  ^  n  ( (a | b) :  A  £  (a|b)  e  R  )  £  R,  (3.88) 
noting  trivially  that  for  any  (a  b)  c  R. 

(a|b)  *  cond((a|b)).  (3.89) 

The  chief  results  Include  the  .following  (see 
[7),  Theorems  6. 1,6. 2,  and  Corollary  6.3): 

(I)  If  now  R  Is  a  complete  boolean  algebra,  then 
for  any  A  £  R, 

cond(A)  »  (4(A)|4(A)  v  (v(A))')  (c  R),  (3.90) 

yjjjg  pg 

4(A)  •  4a  .  v(A)  ^  va  (3.91) 

acA  acA 

are  the(poss1bly  non-flnltelextended  definitions  of 
4  and  v  due  to  the  completeness  of  R. 

(II)  Let  R  ■  8,  the  class  of  all  borel  subsets  of 
t,  the  real  (or  one-dimensional  euclidean)  line.  Let 
g:*"V  X  be  any  function,  denote  the  natural  extension 
of  g  to  P(x)  restricted  to  8  (cf(i)l  as  simply 
g:8™-  t  (assuming  g  is  sufficiently  measurable).  In 
turn,  denote  the  natural  extension  to  p(8)  restricted 
to  i,  the  conditional  extension  of  8,  as  simply 

g:8"-P(8).Then  for  all  (borel  sets)  a.,b.  c  B,  with 
aj  c  bj,  i*l,,,m,  noting  as  ordinary  Sets.c  replaces 

s,  n  replaces  4,  u  replaces  v,  etc., 

cond(g((a^|bj),..,(am|bm)))*  (a ] B) •  (3.92) 

Where  g(a,....am).  (3.93) 

8  *  a  u  (g(b-j->aJ ,. .  ,bra a^) ) *  ,  (3.94) 

where  here  j  •  b'.  u  a^  . 

if  g  Is  commutative  and  associative,  then  so  Is 
jn 

cond(g):B  -  8  . 

The  above  development  is  particularly  useful  In 
determining  the  optimal  approximations  for  naturally 
extended  arithmetic  operations,  since  these,  unlike 
the  boolean  operations ,  In  general  do  rot  possess 
closure  properties  over  8.  These  results  lead,  in  se¬ 
quence,  to  the  development  of  random  conditional  events 


and  related  Ideas.  (See,  in  particular,  [7],  sections 
7.3  and  10.4.) 

4.  PROBABILITY  EVALUATIONS  AND  APPLICATIONS- 

Followlng  the  brief  overview  of  the  role  of 
data  fusion  In  developing  a  generic  model  for  typical 
C3  processes  In  section  1  and  the  motivations  and 
mathematical  and  computational  structures  for  condit¬ 
ional  events,  this  section  presents  the  fundamental 
links  for  probability  evaluation  and  application  to 
combining  of  evidence  and  data  fusion. 

First  note  the  following  theorem  : 

Theorem  4.1.  ([7],  Theorems  1.5,  7.1,  Remark  1.3) 

Let  p:R  -  [0,1]  be  a  given  probability  measure. 
Then: 

(I)  With  slightly  additional  conditions  placed  upon 
P  (non-atomicity),  the  only  possible  extension  of  p 
to  first  psR^  -  [0,1]  ,  for  each  bcR,  and  then  to 

p:R  -  [0,1],  where  p((a|b))  Is  some  fixed  function 
(not  dependent  upon  any  given  a,b  c  R)  of  p(a4b)  and 
p(b)  such  that  p((- 1  b)):R.-[0,1]  Is  a  probability 
measure  Is 

p( (a | b) )  »  p(a|b)  «  p(a4b)/p(b),  (4.1) 

l.e.,  ordinary  conditional  p-obablllty  must  be  assign¬ 
ed  to  conditional  events. 

(II)  The_extension  p:R  -[0,1]  Is  monotone  increasing, 
l.e.,  for  any  a,b,c,d  c  R, 

(a | b)  s  (c | d)  implies. p(a|b)  *  p(c|d).  (4.2) 

By  using  the  demorgan  property  amona  others 
(set  Theorem  3.7(111)  and  Corollary  3.1  ),  all  com¬ 

putations  for  probabilities  of  (compound)  boolean 
functions  of  conditional  events  can  be  reduced  to  com¬ 
puting  probabilities  of  only  conjunctions  of  condition¬ 
al  events.  With  this  In  mind, the  following  result 
shows  that  the  measure-free  conditional  event  approach 
presented  here  In  conjunction  with  probability  evalu¬ 
ations  can, in  a  sense.be  Identified  with  a  modified 
form  of  Approach  8  given  In  section  2.3,  with  the 
joint  probability  measure  p  ,  in  effect ,  determined 
through  conditional  event  conjunction  and  initial 
probability  measure  p  over  R: 

Theorem  4.2  (  [7],  section  10.4,  Issue  (x) ) 

Let  p:R  -  [0,1]  be  a  given  probability  measure, 
let  b,d  c  R  be  arbitrary  with  p(b),p(d)>0.  For  each 
s,t  c  «,  consider  the  Infinite  left  rays 

as  1  (— ,s]  ,  ct  i  (— ,t]  .  (4.3) 

Then,  p((a$|b)4(ct|d)) ,as  a  function  of  (s,t), 

Is  a  legitimate  cumulative  probability  distribution 
function  over  l2  with  p((asP)S(dtd)),as  a  function  of 

S,  and  p( (ct |d)4(b|b) ) ,  as  a  function  of  t,  being 
marginal  cumulative  probability  distribution  functions 
over  z.  I 

BASIC  PRINCIPLES  FOP.  EVALU¬ 
ATING  PROBABILITIES  OF 
CONDITIONED  INFORMATION 


(1).  Determine  whether  or  not  the  evidence  has  truly 
differing  antecedents. 

<Zl  If  the  antecedents  of  the  information  are  identica\ 
then  apply  the  usual  calculus  of  relations  for  PL.  For 
example,  suppose  the  same  source,  sensor  or  human,  on 
two  different  occasions  produces  an  estimate  of  target 
location  and  it  Is  desired  to  obtain  the  probability 
of  the  disjunction,  since  If  the  resulting  probability 
Is  sufficiently  low,  no  further  investigation  will  be 


carried  out.  If  the  source  error,  though  possibly  in¬ 
dependent,  Isrelatlvely  small,  then  both  target  est¬ 
imates  can  be  considered  unconditioned  information. 

Or,  perhaps,  by  sheer  coincidence,  the  same  error 
causing  mechanism  is  present  and  behaves  the  same  way 
In  producing  the  two  estimates,  which  themselves  can 
differ  greatly  In  terms  of.  random  behavior  and  prob¬ 
ability  characteristics.  Or,  further,  where  Approach 
B  Is  valid:  the  actual  joint  probabilities  of  the 
source  random  mechanism  are  known,  one  can  then  re¬ 
duce  all  computations  to  that  Involving  only  PL,  be¬ 
cause  of  the  comon  Joint  antecedent. 

(ft.  But,  In  general,  as  In  the  simplified  examples 
In  section  2.1,  the  antecedents  of  arriving  condition¬ 
ed  information  arise  from  widely  varying  sources,  of 
which  little  or  nothing  Is  known  concerning  joint 
probability  distributions,  yet  relatively  much  Is 
known  concerning  the  Individual  (consequent)  event 
probabilities. 

(IX  Isolate  all  the  relative  unconditional  events 
a, b,c,d,e,f,..  making  up  the  forms  of  the  Individual 
conditional  probabilities  p|a|b),  f^c|d),  p|e|f),.. 

(51  Temporarily  Ignoring  the  probabilities,  deter¬ 
mine  just  what  compound  boolean  operation  Is  desired. 
Perhaps  one  simply  Is  seeking  to  obtain,  In  some  way, 
the'jolnt"  probability  of  (a|b),  (c|d),  (e|f),1.e, 

In  actuality,  the  probability  of  the  conjunction 
(a|b)A(c|d)&(e|f)  ,  or  any  other  combination  as  In 
the  examples  previously  mentioned.  Carry  out  the 
measure- free  computations,  based  upon  the  boolean 
function  desired.  In  accordance  with  the  calculus  of 
conditional  event  operations  as  given  In  section  3,3. 
Hot*,  that  anjr  such  operation  reducethe  collection 
of,  possibly^ many, conditional  events  to  a  single  con¬ 
ditional  event,  say  (ala),  where  now  a, a  are  known 
boolean  functions  of  tne  input  events  a,b,c,d,e,f... 

(EX  Approximate  by  a  single  probability  measure  p, 
say.  In  place  of  all  the  differently  arising  probabil¬ 
ities  In  step  4,  so  that.  In  a  consistent  sense, 

p(a&b)*Pj(a&b),  p(c*d)»p2(cJd),  p(e&f)*p3(e&f),  .. 

Obviously,  If  the  very  same  event,  say  b  Is  assigned 
two  distinct  probabilities  from  two  sources,  say 
p.(b)  and  p.(b),  some  concensus  must  be  determined 
before  a  final  common  assignment-  by  perhans  use  of 
least  squares,  maxi mum  likelihood,  or  maximal  entropy 
techniques. 

In  lieu  of  step(4).  It  Is  possible  that  the  con¬ 
ditional  probabilities  are  all  given  relative  to  some 
coimnon  joint  probability  p^*p,  1*1,2,..,  in  which  case 

the  computational  task  simplifies. 

(71  Simply  use  eq.  (4.1).  An  example  of  a  very 
general  formula  encompassing  the  probability  evalua¬ 
tion  of  an  arbitrary  boolean  function  qf  multiple 
conditional  events  (consider  again  the  comments  at 
the  beginning  of  Corollary  3.1)  Is  given  In  (3.32). 

OX  A  related  Issue  to  the  actual  carrying  out  of 
the  above  steps  In  considering  data  fusion  problems 
Is  that  of  bounding  uncertainty  or  Information.  One 
straightforward  result  is  the  following,  utilizing 
the  results  of  section  3.3  and  the  well  known  Frfchct 
bounds  for  probabilities  (see,e.g.[12]) : 

Theorem  4.3. 

For  any  a j c  R,  J*l,..,n,  and  probability 

measure  p:R  *  [0,1],  (44) 

max(o,  ?pU  |4bi)-(n-l))sp(  4(a.|b  ))s  min  (p(ajb  ))  , 
j»l  •!j=l'r  n  j*l  j  i  J*l...,n  3  J 

max(p(a.|b  ))sp(  v(a  |b  ))s  min(l ,  ?  p(a  .|  Sb5)).(4.S) 
j»l,..,.J  J  j=l  3  J  j*l  J  j*lJ 

I 

Making  the  usual  definitions  for  information 
uncertainty  or  entropy,  for  any  a,b  c  R,  p(b)>0, 

Hp(a|b)  =  -log(p(a|b))  , 


it  follows  that  Theorem  4.3  can  be  converted  immedi¬ 
ately  to  bounds  on  information  uncertainty. 

Ideally,  what  Is  sought  Is  the  conditional 
event  calculus  -as  developed  here-  analogue  of  Hail - 
perfn's  results  [12]  concerning  the  bounding  of  prob¬ 
ability  values  (and  hence,  correspondingly,  informa¬ 
tion  uncertainty)  for  arbitrary  boolean  functions  of 
unconditional  events  when  probability  bounds  are 
known  for  the  individual  (unconditional)  events.  How¬ 
ever,  at  this  point,  one  must  be  content  with  the 
rather  simple  results  given  In  Theorem  4.3,  until  fur¬ 
ther  'results  are  obtained  In  this  area.  These  proper¬ 
ties  also  tie-in  with  CPL  and  the  weakened  forms  of 
Implication  mentioned  In  section  3.5(11)(XII),  More 
details  of  this  will  be  presented  in  future  work. 

Generalizing  the  situation  described  In  steps 
and  (7X  one  can  have  events  of  Interest  a,,b.,c.,d  , 
...  *.  (null  event),  n.  (universal  event)  al 1 ’belong¬ 
ing  to  boolean  algebra’of  events  R,  corresponding  to 
common  probability  measure  p,:^-*-C0,l],  for  i*l,2, 
say.  But,  by  making  the  usual  marginal  Identifications 
a-j'ajXfi^,  b^'b^x^,. .  .a^Qjxa  .b^n^ *b2,. . ,  and  assum¬ 
ing  that  the  joint  probability  measure  p  of  p.  and 
P2  Is  known,  noting  that  because  of  (4.1)° 

pi(*iibi)*po(artl2ibrtl2) .  (4,7) 

p2(a2lb2)"Po(ni,'a2|b2xn)  *- *  *  ’  (4,8) 

it"  follows  that  all  of  the  previous  steps  are  now  val¬ 
id  for  the  situation  here  with  p  replacing  p,  and  the 
marginal  Identifications  for  the°events. 

0 OX  Higher  order  conditioning,  l.e.,  when  the 

events  in  the  above  steps  such  as  a,b,c,...  are  In 
actuality  111  cShdltloned  form  already  (which  may  well 
be  a  common  situation),  can  be  treated  in  a  straight¬ 
forward  way  by  use  of  the  results  in  section  3.S(111). 

01).  Finally,  It  should  be  remarked  that  for  non¬ 
stochastic  information,  such  as  that  containing  ling¬ 
uistic-based  evidence,  as  considered,  e.g.,  In  [11], 
an  analogois  calculus  of  conditional  forms  can  be  de¬ 
veloped,  based  upon  (3.11)  and  the  natural  extensions 
of  operations  [13],  The  corresponding  full  ALDP’s 
should  prove  of  use  in  treating  combination  of  evi¬ 
dence  problems  and  data  fusion  In  general. 
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